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The Basic Skills of Prospective Teachers: 
How Well Do They Read/Write/Speak? 

Mary M. Dupuis and Edward R. Fagan 
The Pennsylvania State University 

The popular press has been reporting in the past few years that 
teachers are not well skilled in areas which they are called upon to 
teach (Leiser, 1981; Lyons, 1980). Educators have long accepted that 
a teacher cannot teach what s/he does noi know. This syllogism seems 
especially telling when it is applied to the basic skills of reading, 
writing, and speaking. With recent public attention focused on basic 
skills instruction, the question of teachers' level of competence in 
these basic skills becomes a matter of some importance to teacher 
educators. 

The Penn State University faculty preparing secondary teachers becar.e 
concerned abou^ tfiis problem several years ago. At issue was the question: 
how can we verify to ourselves and to potential employers of our graduates 
that they are competent in these three basic skills? A search of the 
literature was instituted looking for effective assessment procedures and 
evidence of teachers' ability (or inability) to use these basic skills. 
In fact, we found no evidence of teachers' basic skill levels, either 
positive or negative, except for a small "tudy of elementary teachers' 
ability to use study skills (Askov, Kamm, and Klumb, 1977). We questioned, 
then, how effectively our prospective teachers could use their communication 
skills in professional situations. 



The authors are grateful to Sandra L. Snyder, Mary Kopa, and Bernard 
J. Badiali for their assistance in conducting this research. 
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To clarify these basic s^ 



a Penn State faculty has agreed that 



reading, writing, and speakin 



^ skills generally includ<^d as 



li 



basic." Although we can add a 



oiber of skills we believe to be 



II 



basic" to good teaching, we have 5 



^d this generic definition of the 



basics. We have more recently added co.. mutation to these basics, but we 
do not report on that skill here. 

A little background . The P,enn ^ . ite program in Secondary Education 
prepares teachers in EFigl ish/Communication, foreic)n languages, social 
studies, mathematics, and the sciences. A newly revised program, under 
development for over two years, was formal Ij, begun in September, 1979. 
During the period of revision, the program was formulated on a competency 
base. Included in this list of competencies was a straightforward state- 
ment that each student wilT demonstrate his/her ability to read, write, 
and speak effectively in professional situations. 

When the program faculty became serious about making this competency 
operational, it was easy to decide that the University's introductory 
coursework in these skill areas was not sufficient to verify professional 
level competence. That is, requiring a grade of C or better in freshman 
composition or speech courses was not sufficient. The development and 
implementation of the necessary assessment procedures is the subject of 
the paper which follows. Our goal is to demonstrate to a skeptical 
public--and oursel ves--that the teachers we recommend for certification 
can use these three basic ski 1 1 s effectively in their professional work. 

The Assessment Procedure 

The basic assessment procedure is conducted in the first of three 
generic methods courses preceding student teaching. A full description 
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of the Penn State program is available in Fagan (1981). The assessment 
procedure includes three parts: (1) The Nelson-Denny Reading Test, (2) 

The Criterion-Referenced Test of Reading/Writing Competence, and (3) a 

< 

videotaped speaking assessment. 

Assessing our students' reading ability was a major concern, because 
there is no Uni versity-v/ide assessment of reading, hence no data of any 
kind on students' reading levels. As a result, we included two different 
assessments of reading. The Nelson-Denny Reading Test Form D, a widely 
used standardized test for adults, was chosen because it has demonstrated 
validity and reliability (.95 at the college level). Furthermore, it is 
easy to administer and score. We use the short version, which allows 10 
minutes for the vocabulary section, and 20 minutes for the comprehension 
section. The 30-minute test was administered during a regular class 
meeting. Three scores are generated from the Nelson-Denny: Vocabulary, 
Comprehension, and Total. The Total score is figured from the raw scores 
according to the formula T = V + 2C. Percentile scores are derived for 
each of the three raw scores. 

The Criterion-Referenced Test for the Assessment of Reading and 
Writing Skills of Professional Educators (called the CRT) was developed 
as a test of professional reading and writing skill. Whereas the Nelson- 
Denny uses passages on general topi cs for its comprehension assessment, 
the criterion-referenced test is based on the reading of an article in a 
professional journal, "What's New in Ability Grouping?" (B. J. Wilson 
and D. W. Schmits)' from the Phi Del t a Kappan (59:8, April 1973, 535-6). 
The rationale for such a professional reading source is that a teacher 
should be assessed on reading material similar to that which s/he will be 
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reading as part of his/her continuing professional development. The 
Kappan is recognized as a respected and wel 1-wri tten journal of general 
interest to teachers. 

The criterion-referenced t^st establishes four objectives to be 
measured for reading: 

Given the professional reading selection, the prospective teacher 
wi 1 1 demonstrate: 

1. understanding of professional vocabulary used in the reading; 

2. ability to answer literal level comprehension questions (known 
as low comprehension); 

3. ability to answer inferential level comprehension questions 
(known as high comprehension); 

4. ability to interpret information found in tables. 

Thus, the test has four sections and we derive five scores from it: 



1. 


Vocabulary 


6 


i tems 


2. 


Low Comprehension 


- 5 


i terns 


3. 


High Comprehension 


- 9 


i tems 


4. 


Data Interpretation - 


- 3 


i tems 


6. 


Total 


- 23 


items 



Comprehension levels here are defined as in Barrett's Taxonomy of 
Reading Comprehension (Barrett, 1972). The four levels given by Barrett 
correspond roughly to Bloom*s Taxonomy of Cognitive Levels (Bloom, 1956) 
for Levels 1, 2, and 3 (see Figure 1), while Level 4, Appreciation, 
belongs in the Affective Domain. The CRT in reading tests only Levels 1 
and 2 of Barrett's Taxonomy. Level 3, Evaluation, is tested by the 
writing sample, a second part of the CRT. For the writing sample, students 
are asked to respond in writing to one of two Level 3 questions related to 
the same reading selection: 
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1. What does the information contained in this article sirggest 
about the influence of research results on instruction? In 
your opinion, is this an accurate representation of the 
application of research findings in instructional practices 
in general? Suggest ways that research could have a greater 
influence on instruction. 

2. The author notes that the data reveals a "consistency agree- 
ment among teachers" regarding ability grouping. Suggest 
some possible reasons for this widespread agreement. 

Insert Figure^l About Here 

This organization for assessing reading is hased on the need for 
readers to move up the taxonomic levels as they read and consider a- 
passage. Thus, our assessment procedure asks the pro:.pective teacher to 
(1) read the article; (2) complete the CRT on reading; (3) complete the 
writing sample. The entire assessment can be completed by most students 
in a 75-minute period, although the test is not timed. Students are 
allowed to use as much time as necessary to complete the assessment which 
is given in our Instruction Support Center, an independent learning 
center, at which the student makes an appointment at his/her convenience. 
These two assessments of reading clearly have several differences: 

criterion-referenced vs. norm-referenced 

not timed vs. timed 

individual scheduling vs. group testing 

professional material vs. general material 
The reading assessments are computer scored, yielding raw and 
percentile scores for the Nelson-Denny, and raw scores for the CRT. 

The writing assessment is scored hoi is tical ly , as prescribed by the 
College Entrance Examination Board (Kirrie, 1979). In this study, holistic 
scoring followed the procedures given in Cooper (1975), with scores given 
from 1 (low) to 4 (high). 
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Ficure 1 

Barrett's Levels of Comprehension Related 
to the Taxonomy of Cognitive Levels 



Bloom 
6 Eval uation 
5 Synthesi s 




4 Analysis 
3 Application 



2 Inferential 



2 Comprehension 
1 Knowledge 



3 Literal 
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Because of the volume of essays, several raters are required. The 
total N of 217, covering five separate cycles of students, means that 434 
essays were read (each essay was read by two separate raters). In 
addition, the Secondary Education program is an ongoing process running 
two separate assessments of new groups of prospective teachers each year. 
Thus, corollary concerns were the establishment of adequate interrater 
reliability and the training and use of different raters over time. 

The first essay rating session in Fall 1980 fusing 43 essays) used 
nine raters (one faculty member and eight graduate assistants). After a 
two-hour training session, the raters' reliability was figured at .71 
using Winer's (1962) formula. The second rating session in Fall 1981 
(using five essays) used six raters (two faculty members and four graduate 
assistants). After similar training, the interrater reliability was 
figured at .73. Only two of the fifteen raters -were the same for both 
sessions. The 1982 raters (three faculty and five graduate assistants) 
reached an interrater reliability of .30. We believe that both conditions 
stated were met: the interrater reliability was high enough for our 
assessment purposes, and raters from different backgrounds were tr*"ained 
in a reasonable period to conduct tlie ratings. Among the raters in these 
sessions were professionals from reading and English, as expected, but 
also from science, foreign languages, math, and social studies. 

Oral speaking has received less attention in the public press and the 
professional discussions of communicative competence than reading and 
writing. However, teacher educators generally agree that oral communication 
is used more frequently in the classroom than writing. Research in teacher 
effectiveness underscores the importance of oral communication (Snyder, 
1981b). Speaking assessment in this program is designed to place 
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prospective teachers in a professional situation, speaking in a fairly 
formal way to their peers. Groups of four to six prospective teachers 
from different content areas speak on a professional topic of their 
choice for five minutes. These speeches are videotaped so they can be 
assessed at a later time by competent raters. These videotapes can also 
be viewed by the speaker for self-evaluation and, if necessary, to provide 
the basis for diagnosis and remediation. 

The scale used in rating these speeches was developed as part of the 
assessment program. The development and validation of the scale is 
reported in detail elsewhere (Snyder, 1981a, 1981b). The scale (given 
as Figure 2) contains five areas, each one containing specific ^components. 
Each rater checks the components occurring within a speech, then converts 
the checkmarks to a numerical score from 1 (low) to 4 (high) on each 
component. ^ The components are weighted according to the importance of 
that component to the speaking situation. Weightings are derived from 
both speech communication and teacher effectiveness research (Snyder, 
1981b). The greatest weight is placed on Organization and Development 
and Adaptation to the Audience. These two components account for nearly 
half (48) of the 100 points possible. A sixth component. Overall 
Impression, provides for a holistic evaluation of the speech, using the 
same procedures as the holistic assessment of writing. 

Insert Figure 2 About Here 

Each speech is rated independently by two raters after a two-hour 
training session. As with writing, the training session for speaking 
follows CEEB suggestions and uses speeches drawn at random from earlier 
assessments. The first"" set of speeches in Fall 1980 (n=44) was rated by 
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Figure 2 
Speaking Assessment 



RATING FORM 



Key: 

1 

2 
3 
4 
■/ 



poor 

below average 
above average 
very good 

each descriptor where performance 
is acceptable 



Time: Start 

Name: 

Topic: 



Finish 



Organization and Development 



Purpose clear 
Main ideas clear 



Main ideas consistent with purpose 

Smooth transitions 

Adaptation to Audience 

Provides sufficient information 

Eye contact with audience 



Relate message to audience 

Clear explanations 

Language Usage 



Use of appropriate vocabulary 
Use of standard English dialect 
Enunciation 

Use of conventional grammar 



Ability to Motivate Audience 
Personal involvement 



Speaks expressively 

Uses variety in presentation 

Uses visual aids 

Delivery 



Speaks audibly 
Speaking rate 
Posture 



Body movement and gestures 

Overal 1 Impression 



(x6) 



Logical sequence of ideas 
Information factual 
Use of evidence 
Concl uding statement 



1 2 3 
Total score 



(x6) 



12 3 4 (x5) 



12 3 4 (x3) 



1 



1 2 3 4 /(x3) 



(x2) 



Coinments ; 



<5 Developed by Sandra Snyder ^ 

hKJC II 
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four raters, all graduate assistants. Their interrater reliability 
(Winer, 1962) was assessed at .92. The second set of speeches in Spring 
1981 (n=55) was assessed by seven raters, all but one of whom were 
different from the first set. The interrater reliability of the second 
assessment was figured at .93. The most recent training session (Fall 
1982) included eight raters (four feculty and four graduate assistants) 
rating ten speeches (10 percent of 97). The interrater reliability was 
.91. Both the reliability and the training of multiple raters meet the 
program's criteria for precision, consistency, and practicality. 

Resul ts and Their Implications 

We have looked at the results of these assessments in two ways, related 
to the two questions given earlier. First, we considered their reliability 
and validity. We evaluated the results of the reliability studies reported 
above and determined that the scoring procedures for the writing and 
speaking assessments were sufficiently reliable for screening purposes. 
The validity of the four assessment procedures seems sufficient, based as 
they are on the extant literature and, in the casej>/ the Nelson-Denny, 
wifle use. 

Our second question dealt with how well our students measure up in 
each area of the assessment. The answer to this question supports the 
answer to questio i 1, as well, since discriminating between weak and strong 
levels of the tested skill is a requirement for content validity. 

We have gathered data on a large number of variables related to this 
research. Table 1 presents the mean scores on the important variables. 
Our students score well on the national norm- referenced tests. SAT scores 
of 1000 are certainly respectable, as is the 60+ percentile on the 



12 



11 



Nelson-Denny. Fewer SAT scores are reported, because some specific groups 
within our. secondary education student population are not required to 
report SAT's (veterans, graduate students). 

Insert Table 1 About Here 

More meaningful data are seen in the comparison of students who score 
above and below cutoff on eac1i of ^ these assessments. Cutoffs were 
established through the first year of the assessment, using the first two 
cycles as the pilot group. The CRT-Reading cutoff was set at one less than 
maximum on each objective, or a total of 19. Writing and speaking, using 
the holistic scores for screening, follow the CEEB recommendations that 
3 (of a possible 4) is the minimum acceptable level of competence. The 
40th percentile on the Total score was. adopted for the Nelson-Denny, based 
on the publishers' findings and the correlations between the two reading 
tests. The relevant correlations (reported in TabVe 2) are significant, 
even though the percent of variance accounted for is relatively low (^9). 

Insert Table 2 About Here 

The percentages' of students successfully completing each of the four 
assessments on the first try is relatively reassuring, as reported in 
Table 3. At least 70 percent of our prospective teachaps are competent 
in each category. We are not surprised that 19 percent of our students 
succeeded in the Nelson-Denny. Such standardized tests are familiar to 
our students. In addition, the Nelson-Denny correlates highly (.43) with 
the SAT-verbal score. In that sense, the Nelson-Denny gives us relatively 
little information beyond that available from the SAT. The CRT-Reading 
test, however, causes our students more difficulty than the Nelson-Denny. 
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Table 1 

Mean Scores of Critical Variables 



Variable 

Nelson- Denny Reading Test (%iles) 
Voca bulary 
Comprehension 
Total 

Criterion-Referenced Test - Reading 



62 
61 
64 



n 

207 



Possible 



Vocabulary 
Comprehension - Low 
- High 

Data Interpretation 
Total 

Writing Assessment 

Speaking Assessment 

SAT - Verbal 

- Math ■ 

- Total 



4.96 
.4.74 
7.13 
2.17 
18.93 

.2.90 

2.91 
71.77 

473 
526 
999 



(6) 
(5) 
(9) 
(3) 
(23) 

(4) 

(4) 
(100) 



217 



210 

207 
142 

142 



GPA 



2.90 



211 




14 



13 



Table 2 



CRITERION-REFERENCED TEST 
Vocabulary .25** 
Lo Comprehension -.',5 
Hi Comprehension .30** 
Data Interpretation 
Total .27** 



NELSON- DENNY (%ile) 
Vocabulary 
Comprehension 
Comprehension 

Total 



** p < .01 
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Students report that it is more challenging, because of the professional 
nature of the reading material. The mean scores on its subtests (see 
Table 1) show some difficulty with both Vocabulary and High Comprehension- 
two reading skills we think are important in dealing with the professional 
literature. 

Insert Table 3 About Here 

Writing and speaking scores both demonstrate a high percentage of 
competence on this assessment. Given the rating system and the reliability 
levels attained consistently, it is valuable to point out the high levels 
of competence reported here— except for one subject area. The totals 
given in Table 3 would be radically different without the social studies 
area. Of the remaining four subject areas, 18 percent of the student:) are 
not competent in writing and 15 percent in speaking. We are, of course, 
pleased that students in four areas rate so highly. We are unable to 
account for the high percentage of prospective social studies teachers 
who demonstrate low levels of skill in writing and speaking. 

Our research into the differences by subject area is continuing, as 
is our analysis of students who demonstrate deficiencies in more than 
one skill. To date, 63 students have registered deficiencies in one 
skill, 43 in two skills, 7 in all three skills (these data exclude the 
Nelson-Denny scores). We are also studying the retention rates of 
students who begin with these deficiencies. 

Differences^by sex . All data were treated by analysis of variance 
by sex, in order to determine whether the expected differences would occur. 
On a number of variables^ the females (n=n5) exceeded the males (n=107): 

er|c is 



Table 3 

Student Assessments Related to Cutoff Scores 





Nelson- Denny 


CRT Readii^g 


CRT Writing 


Sneak i no 




(40th %ile) 


(19) 






(3) 




above 


below 


above 


below 


above 


below 


above bel 


English/Communication 


40 


12 


38 


14 


44 


8 


46 6 


Math 


31 


9 


27 


13 ;. 


30 


1 


28 12 


Science 


45 


7 


44 


8 


43 


9 


47 5 


Social Studies 


49 


17 . 


36 


30 


37 


29 


45 21 


Foreign Language 


10 


1 


9 


2 


10 


1 


10 1 


Total 


1 /b 


HO 


11)4 


D/ 


164 


57 


176 45 


I 


79% 


21% 


m 


30^^ 


74% 

1 


26% 


80% 20 



ERIC 



17 



16 



Variable 



Nelson-Denny Scores 



8.512-1K893** 



Criterion-Referenced Test - Vocabulary 



5.855* 



Writing 



28.053** 



Speaking 



4.080* 



SAT - Verbal 



5.746* 



GPA 



30.531** 



* p < .05 
** p < .01 

On the SAT - Math, and all sections of the CRT except vocabulary, differences 
by sex were not significant. 

However, in grades in relevant courses, males exceeded females in 10 
of 12 courses (significant F values ranging from 6.377 to 23.313). The 
two courses in which difference by sex was not significant include student 
teaching. 

^ This suggests that the variables used to predict success and the 
grades used to evaluate success respond differently to the sex variable. 
Both general predictors, like GPA and SAT scores, and our specific skill 
assessments (including criterion-referenced scores in vocabulary, writing 
and speaking, and the norm- referenced Nelson-Denny) favor the females in 
our sample. But course grades, in general, favor males. The exception of 
student teaching is important; since that is seen as the capstone of the 
teacher preparation program. We are interested in the lack of sex 
differences for most of the CRT-Reading test, since the traditional norm- 
referenced tests, like the Nelson-Denny» have consistently shown the 
difference reported here. 
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Analysis of skills assessments . One concern of this research is 
to establish that these assessments provide information not available 
from other data. Hence, we studied correlations between these basic 
skill assessments and the SAT scores and course grades available on our 
students. Table 4 reports these data. The correlations are generally 
significant, but at a level which suggests that much information in both 
variables is not explained by the correlation. 

Insert Table 4 About Here 

Figure 3 includes the i ntercorrelations of the basic skills assessments 
themselves. It is accepted philosophically that these three language 
skills are related. However, when our assessments are correlated, we do 
not find that strong relationship. The correlations between reading and 
writing range from .32 to .36, strong but not overwhelming. The 
correlations between writing and speaking are slightly weaker (.27-. 33). 
The correlations between reading and speaking, all non-significant, show 
the weakest relationship of all. The connection ^between reading and 
speaking is tenuous, at best, given these data. However, their consistency 
across different tests suggests that the assumed relationships among these 
language skills deserve greater research. 

Insert Figure 3 About Here 



Conclusions 

We believe that the assessment procedure described here has been 
demonstrated to be valid and reliable as a screening device for professional 
educators. The procedure has been used by different staff on five separate 
cycles of students. We have moved from these data to make successful 
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Table 4 



Correl ations 
between Basic Skills Assessments 
and Critical Variables 
n > 113 



SAT - Verbal - Nelson-Denny total 



.43** 
.28** 
.30** 
.08 



CRT - reading total 
CRT - writing 
Speaking 



Speaking Assessment - Speech course grades 

1-4 scale - .19 
100-point scale - .24* 



Writing Assessment - English Composition course grades 

English 10 - .21* 
English 20 - .31** 



* p .05 > .20 
** p .01 > .25 
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Figure 3 

Correlations of Basic Skills Assessments 
n > 193 



READING 




WRITING < > SPEAKING 

.27 - .33 



p < .05 = .20 
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completion of this assessment prerequisite to continui'^ij In the professional 
program. We have also moved to develop a second form of the criterion- 
referenced reading/writing test. 

We believe, too, trat the quality of students coming into our 
secondary education program is an important issue. The majority of our 
students can be proud of their scores, of their competence in these 
skills. Indeed, we make this information part of their placement record. 
Employing superintendents ind graduate schools have indica'ted that they 
find it useful. Those students who do not meet our standards for competence 
are a concern. Most of them, when confronted with these results in private 
conferences, admit that these skills have always been a problem. Many of 
them transfer voluntarily to other majors. Others seek remedial help in a 
number of ways. 

The program faculty remains convinced that students who have not 
demonstrated theii competence should not be allowed to continue in the 
program. They are bolstered by the relatively high correlation between 
these scores and grades in student teaching. 

As a result, the program faculty is undertaking a more thorough 
analysis of these data and other appropriate data from the student teaching 
experience. It is important to be able to demonstrate the connection 
between these basic skills assessments and success in student teaching. 

Thus, in a number of ways, we are continuing this research into the 
basic skills of prospective teachers. We owe it to our students and their 
students to ensure their competence. 
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